J) 



Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Bescheinigung Certificate 



Attestation 



o 



(AO : 

c i 



=0 



Die angehefteten Unter la- 
gen stimmen mit der 
ursprunglich eingereichten 
Fassung der auf dem nach- 
sten Blatt bezeichneten 
europaischen Patentanmel- 
dung (iberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conformes a la version 
initialement deposee de 
la demande de brevet 
europeen specifiee a la 
page suivante. 



Patentanmeldung Nr. Patent application No. Demande de brevet n° 

98307353. 7 



Der Prasident des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de rOffice europeen des brevets 
p.o. 



DEN HAAG,DEN 

THE HAGUE, 05/07/99 

LA HAYE,LE 



EPA/EPO/OEB Form 1014 -02.91 





Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Blatt 2 der Bescheinigung 
Sheet 2 of the certificate 
Page 2 de I' attestation 



An me! dung Nr.: 
Application no.: 
Demande n\ 



98307353. 7 



Anmeldetag: 
Date of filing: 
Date de depot: 



11/09/98 



An met der: 

Applicant(s): 

Demandeur(s): 



Two Way TV Limited 
London W4 5TW 
UNITED KINGDOM 



Bezeichnung der Erfindung: 
Title of the invention: 
Titre de I'invention: 

Delivering Interactive applications 



In Anspruch genommene Prioriat(en) / Priority(ies) claimed / Priorite(s) revendiquee(s) 

Staat: Tag: Aktenzeichen: 

State: Date: File no. 

Pays: Date: Numero de depot: 



Internationale Patentklassifikation: 
International Patent classification: 
Classification internationate des brevets: 



Am Anmeldetag benannte Vertragstaaten: 

Contracting states designated at date of filing: AT/BE/CH/CY/DE/DK/ES/FI/FR/GB/GR/IE/IT/LI/LU/MC/NL/PT/SE 
Etats contractants designes lors du depot: 

Bemerkungen: 

Remarks: 

Remarques: 



EPA/EPO/OEB Form 1012 -04.98 



H04L29/Q6, H04N7/24, A63F9/22 



DELIVERING INTERACTIVE APPLICATIONS 
The present invention relates to a method and 
apparatus for delivering an interactive application to a 
plurality of target platforms. 
5 Interactive application providers employ skilled 

programmers to develop new interactive applications. 
Examples of such interactive applications are predictive 
games for use in conjunction with a live sporting 
broadcast, quiz games for use in conjunction with a live 
10 quiz broadcast, on-demand quiz games (ie. not used in 
conjunction with a live quiz broadcast) , home shopping 
applications and home banking applications. 

With the rapid development of new target platforms for 
interactive services (each employing a broadcast network 
15 with a different respective broadcast protocol) it is 
desirable to deliver the interactive applications over any 
chosen network in a simple and cost effective way. However 
conventionally this has been difficult because it has been 
necessary for the skilled programmers to take into account 
2 0 the different broadcast protocols during development of the 
new application. 

In accordance with a first aspect of the present 
invention there is provided a method of delivering an 
interactive application to a plurality of target platforms, 
2 5 the method comprising 

providing a set of application components; 
converting the set of application components into a 
plurality of streams of broadcast data, each stream of 
broadcast data conforming with a respective target 
30 platform; and 

delivering each stream of broadcast data to its 
respective target platform. 

In accordance with a second aspect of the present 
invention there is provided apparatus for delivering an 
35 interactive application to a plurality of target platforms, 
the apparatus comprising 

means for providing a set of application components; 
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a plurality of broadcast systems interfaces each 
converting the set of application components into a 
respective stream of broadcast data, each stream of 
broadcast data conforming with a respective target 
5 platform; and 

means for delivering each stream of broadcast data to 
its respective target platform. 

Instead of having to provide multiple sets of 
application components (each set complying with a different 
10 respective target platform) the invention allows the 
programmers to merely provide a single set of application 
components in any desired format, without needing to know 
anything about the ultimate target platforms. The 
broadcast system interfaces (BSIs) then convert the 
15 application components shortly before, or during the 
broadcast . 

The invention provides a convenient method of 
delivering an interactive application to a number of target 
platforms each having different requirements. For instance 

2 0 the target platforms may comprise broadcast networks having 

different data protocols, formats or speeds. Alternatively 
the target platforms may comprise user interfaces with 
different memory capabilities etc. 

The "open" architecture of the system enables new BSIs 
25 to be added when the interactive application is to be 
delivered to a new target platform. 

In the case where the application comprises a real- 
time application (eg a predictive game for use in 
conjunction with a live sporting broadcast) the method 

3 0 typically further comprises manually inputting real-time 

application data; 

converting the real-time application data into a 
plurality of streams of real-time broadcast data, each 
stream of real-time broadcast data conforming with a 
35 respective target platform; and 

delivering each stream of real-time broadcast data to 
its respective target platform. 



BNSDOC!D:<E1 9830735303> 



II 



The application components and/or real-time 
application data may be generated, converted and broadcast 
on-the-fly. However preferably the method further 

comprises storing the application components and/or real- 
time application data in a data store; and retrieving the 
application components and/or real-time application data 
from the data store before converting it into a stream of 
broadcast data. 

A number of conversion steps may be necessary, 
including translating, substituting, selecting, time 
managing, or adapting for different data transmission 
mechanisms . 

Provision may also be made for return path processing 
of return data (eg game -play input or home banking 
requests) from the target platforms. 

An embodiment of the present invention will now be 
described with reference to the accompanying drawings, in 
which : 

Figure 1 is a schematic functional diagram of an 
interactive service network; 

Figures 2-4 illustrate examples of screen displays 
presented to an operator during preparation for a live 
f ootbal 1 game ; 

Figures 5 and 6 illustrate screen displays presented 
to a remote player of the live football game; 

Figure 7 is a schematic diagram illustrating two 
return data paths; and 

Figure 8 is a schematic diagram illustrating the 
function of the Two Way TV engine. 

Referring to Figure 1, the network comprises a central 
system 1 and a number of target platforms 2 . Each target 
platform comprises a respective broadcast network 3 and 
user interface 4. The central system 1 is controlled by a 
central computer system (CCS) 5 which comprises a Sun SPARC 
binary file designed to operate UltraSPARC architecture 
workstations or servers (not shown) . Although the CCS is 



shown as a single unit it may be split into more than one 
binary file for performance and distributive requirements. 

The CCS 5 communicates with a number of sub -systems 6 
via a CCS text message gateway 7. 
5 Authoring tools 8 include suitable tools (eg PCs) 

which are used by game programmers to develop new 
interactive applications. The interactive applications may 
all be very different but in general will include a number 
of application components such as executable program files, 
10 bitmaps, sound samples, real-time data instructions, video 
clips, and other multimedia and data resources. When the 
new applications have been developed and tested, the game 

TM 

programmer logs on to a Windows NT based submit tool 9 
which saves the application components in an application 
15 database (not shown) . 

A number of previously saved applications are shown in 
Figure 1, namely six interactive, predictive games 10-15 
for use in conjunction with a live sporting broadcast and 
a set of on-demand game engines 16. 

2 0 A set of Universal Live Tools 17 (which include PCs 

running Windows NT™ based applications, and suitable input 
devices) are used by skilled operators to support the live 
applications 10-15 . 

TM 

A Mission Control system 18 (a Windows NT based 
25 application) is used by a system control officer to 
initiate application transmissions and manage real-time 
broadcasts . 

An example of one of the interactive, predictive games 
(football 10) will be described below. The game is 
30 described in more detail in EP98302964 . 6 . In the 

interactive football game, remote players are able to 
attempt to predict certain events prior to commencement of 
a live football match and can also attempt to predict 
certain events during the live broadcast. 

3 5 Initially, prior to commencement of the live 

broadcast, the football application 10 is initiated by the 
system control officer using Mission Control 18, and an 
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operator uses the Live Tools 17 to set up certain 
predetermined information relating to the live broadcast 
for transmission to the user interfaces 4. 

The operator is first presented with a screen as shown 
5 in Figure 2 in which he can select a home team and an away- 
team from a list of such teams which have been previously 
stored in the application database. The operator can 
select the appropriate home and away teams and then click 
the OK button. This information is then stored in a Live 

10 File store (not shown) associated with the Live Tools 17. 
The application database stores information relating to 
each team squad which will typically include more players 
than those actually selected to play the match. Shortly 
before commencement of the match, the actual team will be 

15 announced and this information will be conveyed to the 
operator. The operator then causes the Live tools 17 to 
display all members of the squad of each team (Figure 3) 
allowing the operator to indicate which members of the 
squad have been picked to play and at the same time, he can 

20 define the type of player, for example goalkeeper, 
attackeir, midfield or defender. Once that information has 
been indicated, it is then stored in the Live File store. 

The operator also sets up the particular types of 
event which can be predicted during the live broadcast. In 

25 this example, these events include the time of the first 
goal, the time of the first booking etc. Examples of such 
events are indicated by the line of buttons at 50 in Figure 
4 . 

Once all the information for the live broadcast has 
3 0 been set up by the operator, a screen such as that shown in 
Figure 4 is displayed which at this time is inactive since 
the interactive game has not commenced. It will be noted, 
however, that the operator has been able to set up a 
significant amount of information in advance of the live 
35 broadcast itself . 

At the appropriate time, but before commencement of 
the football game, the operator will click the button 51 
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and the application will then be transmitted to the CCS 5 
and broadcast to all the user interfaces 4 over the 
broadcast network 3 as discussed below. The following 
application components are broadcast: 
5 l. Real-time data instructions such as "display 

copyright message at start of football game"; or "display 
[bit map] at half-time". 

2 . Executable computer code to be run by the user 
interfaces to implement the game. 
10 3. Bit maps - eg. player faces, team logos etc. 

4. Sounds - eg sampled referee's whistle or crowd 
noises . 

5. Video clips, eg of individual players scoring a 

goal . 

15 6. Team data - eg team names, player names and 

player positions. 

The central system 1 is designed to be able to deliver 
applications on any target platform. Five target platforms 
are illustrated in Figure 1, each employing a different 

20 broadcast network, ie. NCI DTV Naviagator 20, OpenTV 
digital TV 21, MHEG-5 22, WebTV/WinCE 23 and PowerTV 24. 

The system can also be expanded to handle any number of 
additional broadcast networks 25. Each broadcast network 
20-25 has a respective different broadcast protocol. In 

25 order to deal with this problem, each target platform has 
an associated Broadcast System Interface (BSI) 26 which 
converts the set of application components associated with 
each application into a plurality of streams of broadcast 
data, each stream of broadcast data conforming with the 

30 broadcast protocol of its respective target platform. Thus 
when the operator clicks on button 51, the set of 
application components (ie. executable program files, 
bitmaps, sound samples, real-time data instructions, video 
clips etc.) are passed to the CCS 5 and then fed as 

35 parallel data streams to the BSIs 26 which convert the 
application components as appropriate prior to delivery 
over a respective broadcast network 3. The BSIs 26 are 
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previously encoded to make any necessary conversions in 
order to conform the data to their associated target 
platform. The conversion may (amongst others) include the 
following techniques : 
5 Translation 

This is the most basic data manipulation. Here the 
data is converted from an internal representation required 
by the authoring tools 8 into a representation appropriate 
to a respective broadcast protocol. 
10 For example, a target platform may only receive ASCII 

text. In this case the BSI converts all data being 
transmitted from a binary representation to ASCII. 

Translation takes place on a byte-to-byte basis and is 
the lowest level of transformation employed by the BSIs 26. 
15 Substitution 

In some cases the BSIs will replace application 
components with an alternative. This is similar to 
translation, except that substitution is normally done at 
a component level . 

2 0 An example of this might take place where a game is 

being broadcast to two networks where the capabilities of 
the user interfaces 4 are different. The game being played 
contains a real-time video component that is delivered to 
the user interface 4 for display. On one network, the user 
25 interface is not capable of storing the video component due 
to lack of memory and the BSI substitutes the video 
component with a set of still frames extracted from the 
video component. On another network the user interface is 
capable of storing the video component and the BSI delivers 

3 0 the video component unchanged. 

In another example a 16 -colour bit map is to be 
delivered and one of the broadcast networks 3 or user 
interfaces 4 may only be able to support an 8 -colour bit 
map. In this case the BSI converts the bit map into 8- 
35 colour format on the fly prior to delivery. 

Selection 



BNSDO^Tl • 3830735303*. 



8 

In the case of selection, the BSI selects which 
application components to send or not to send. An example 
would be an application that contains three different 
binary files, one for a browser target platform, one for a 
target platform with an OpenTV broadcast network, and 
another for a target platform with a PowerTV broadcast 
network. The BSI associated with the OpenTV network would 
transmit the binary file for the OpenTV network, and ignore 
the others. The BSIs supporting the other target platforms 
behave in a similar way. 

Timing 

Different broadcast networks delivering the same 
programme are not necessarily temporally synchronised. 
Differences in timing may be up to one or two seconds, 
indeed set top boxes on different networks would generally 
have slight variances in their clocks, ie a box on one 
network may think that the time is 12:34.00 whilst a box on 
another network may believe it is 12:34.03. In addition to 
different networks having different clocks it is also a 
fact that different networks may not be broadcasting 
content at exactly the same time, ie a video program may 
start up to 1 or 2 seconds later on another network even 
though the clocks are the same. 

In order to manage these anomalies between networks it 
is necessary for the BSI handling that network to 
compensate by introducing the required delay, either by 
delaying the broadcast of messages, or more appropriately 
by altering the timing information within messages. 

Some networks do not provide a synchronised clock on 
all set top boxes. In these cases it is necessary for the 
BSI handling those networks to provide a clock message 
which the user interface may use to update its own 
synchronised clock. 

Data Transmission Mechanisms 

Different broadcast networks will probably use 
different techniques for transmission. Some may present a 
single large bandwidth download path for all data, some may 



provide a high bandwidth mechanism for application 
components, and a smaller bandwidth mechanism for real-time 
data. In all of these cases the BSI will manage the 
different transmission techniques . 

Exploring the above example in more detail, it is 
likely that a browser based architecture would provide some 
mechanism for providing application components from the 
service provider's server, using a carousel for example. 
In this scenario browser BSI would forward all game 
components to the server to be placed on the carousel- The 
binary data messages would most likely be fed to the server 
which would then use IP tunnelling or similar to transmit 
the data to the user interfaces. 

In the case of the MPEG- II system the BSI would 
produce MPEG- I I transmit packets contains MPEG- I I private 
data sections containing the binary data messages and the 
component downloads in a defined format . 

The user interfaces 4 each include a Two Way TV engine 
27 which decodes incoming data and presents it to an 
application processor 2 8 which runs executable program code 
and also incorporates suitable memory for storing data. 
Items 27,28 are typically provided in a set-top-box (STB) 
which is connected to a conventional home TV set. 
Alternatively items 27,28 may be part of a personal 
computer. Although only a single user interface 27,28 is 
shown in Figure 1 with each broadcast network 2 0-25, it 
will be appreciated that each network 20-25 will broadcast 
to a large number of user interfaces. 

In a commercial broadcast such as cable, satellite or 
the internet, the application processors 28 (in the form of 
set top boxes or personal computers) may have different 
capabilities. It is possible that the processors 28 may 
have different graphical abilities (such as colour depth, 
background mpeg and bitmap formats) , different amounts of 
RAM and differing audio capabilities. 



It is not desirable to target the lowest capability 
processor only, as customers who have payed more for a more 
powerful decoder should reap the benefits. 

Therefore in order to provide the highest quality of 
5 interactivity on any given processor it is necessary to 
create applications which can selectively use different 
display models, colour depths, sounds and bitmaps. In 
addition different sections of code may be used for 
different processors. The Two Way TV engines 27 are able 

10 to interrogate the capabilities of the application 
processors 28 at runtime and dynamically decide which 
components of the broadcast applications to utilise. 

The function of the Two Way TV engines 2 7 is 
illustrated in more detail in the example of Figure 8. In 

15 this case a broadcast system interface 70 is encoded to 
convert the application components into the format required 
by an Open TV digital TV broadcast network 71. A second 
BSI 72 converts the application components into the format 
required by a PowerTV broadcast network 73 . Two types of 

20 user interface 74,75 are connected to the open TV network 
71. User interface 74 includes an application processor 76 
which can support 16-colour bitmaps. In contrast, user 
interface 75 includes an application processor 77 which can 
only support 4 -colour bitmaps. The BSI 7 0 delivers 4- 

25 colour and 16-colour bitmaps over the network 71. Each 
user interface 74,75 has a respective Two Way TV engine 
78,79. The engine 78 interrogates the application 

processor 7 6 and determines that the processor can support 
16-colour bitmaps, and so downloads the 16-colour bitmaps 

30 on to the processor 76. In contrast, the engine 79 
downloads the 4 -colour bitmaps and discards the 16-colour 
bitmaps . 

Bitmaps are a relatively simple example, code modules 
are more complex. For instance one type of user interface 
35 may use a store and forward return path mechanism, whilst 
another (on the same network) may use an instant access 
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step comprises broadcasting the stream of broadcast data to 
the application processor via the broadcast network. 

8. A method according to claim 7 further comprising 
interrogating the application processor to determine the 

5 data capabilities of the application processor; and 
downloading data from the stream of broadcast data in 
accordance with the determined data capabilities of the 
application processor. 

9. Apparatus for delivering an interactive application to 
10 a plurality of target platforms, the apparatus comprising 

means for providing a set of application components; 

a plurality of broadcast systems interfaces each 
converting the set of application components into a 
respective stream of broadcast data, conforming with a 
15 respective target platform; and 

means for delivering each stream of broadcast data to 
its respective target platform. 
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CLAIMS 

1. A method of delivering an interactive application to 
a plurality of target platforms, the method comprising 

providing a set of application components; 
5 converting the set of application components into a 

plurality of streams of broadcast data, each stream of 
broadcast data conforming with a respective target 
platform; and 

delivering each stream of broadcast data to its 
10 respective target platform. 

2. A method according to claim 1 further comprising 
manually inputting real-time application data; 

converting the real-time application data into a 
plurality of streams of real-time broadcast data, each 
15 stream of real-time broadcast data conforming with a 
respective target platform; and 

delivering each stream of real-time broadcast data to 
its respective target platform. 

3 . A method according to any of the preceding claims 
20 further comprising storing the application components 

and/or real-time application data in a data store; and 
retrieving the application components and/or real-time 
application data from the data store before converting it 
into a stream of broadcast data. 
2 5 4. A method according to any of the preceding claims 
wherein the step of converting comprises translating, 
substituting, selecting, time managing, or adapting for 
different data transmission mechanisms. 

5 . A method according to any of the preceding claims 
30 further comprising receiving and processing return data 

from one or more of the target platforms. 

6. A method according to claim 5 wherein the application 
comprises a game and the return data comprises game -play 
input . 

35 7. A method according to any of the preceding claims 
wherein each target platform comprises a broadcast network 
and an application processor, and wherein the delivering 



BNSDOCID: <E1 9830735303> 



operator clicks on an appropriate button and the 
information is then transmitted to the user interfaces 4. 

During and/or after a game, the user interfaces 4 
compare the associated player's predictions with the actual 
5 events. If the local player was successful in his 
prediction then the user interface 4 will indicate this to 
the player and will also pass that information via a 
suitable return path (eg the public switched telephone 
network) to the CCS 5 where it is handled by suitable 

10 return path processing 29. 

An example of the return path processing 2 9 is 
illustrated in Figure 7. STB 30 is connected to a cable 
modem 31 which compresses the . return data prior to 
transmitting it over a cable network to a cable service 

15 provider server 32. The return path processing 29 includes 
a decompressor 33 which decompresses the data into a form 
suitable for the CCS 5. STB 34 is connected to a modem 35 
which transmits the return path data to a modem 36 in the 
return path handling system 2 9 over the conventional public 

2 0 switched telephone network (PSTN) . Once the return data 
has been converted by the return path processing system 29, 
it is processed by the CCS 5 which provides standard 
scoring and voting facilities. For instance the users 
playing the football game may each have an individual score 

25 which is stored in a user database 3 0 and updated by the 
CCS 5 when the user makes a correct prediction. 
Alternatively the return path data may be used by the CCS 
5 to register votes from the user interfaces. The return 
path processing facilities provided by the CCS may be 

30 augmented by a plug-in processing application 37. For 
instance a programmer can develop a new game which requires 
overall results or league positions to be broadcast back to 
the user interfaces and a suitable plug-in processing 
application 37 can be installed by the programmer. In some 

35 applications, however, return path communication with the 
CCS 5 is not necessary. 
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high bandwidth modem. Depending on which, the engine 2 7 
would have to load and link the corresponding code module. 

The Two Way TV engines 27,78,79 are generic items of 
code (i.e. the same engine is provided with each user 
5 interface) . This enables the system to be easily expanded 
to deal with a new application processor 28 with different 
capabilities . 

The engines 27,78,79 may either by previously provided 
in a user's personal computer or set-top-box, or may be 

10 broadcast over the broadcast network 3 before broadcast of 
the application components. 

Returning to Figure 8, only a single type of user 
interface 81 is supported on network 73. In this case, the 
BS1 72 broadcasts 16 -colour bitmaps only, and the engine 83 

15 downloads the 16-colour bitmaps to the processor 82. 
Therefore in this case the engine 83 is effectively 
"transparent" as far as the 16-colour bitmaps are 
concerned . 

When the application has been downloaded to the user 

20 interfaces 4, the interfaces display a screen similar to 
that shown in Figure 5. This indicates to the player the 
type of prediction which he can attempt- A comparison of 
Figures 4 and 5 will show that six of the events selected 
by the operator for prediction set out in the line 50 are 

25 displayed on the display of Figure 5. 

The remote player can then select one or more of the 
predictions. For example, if he selects the "Time Slot of 
First Goal", the screen shown in Figure 6 will be displayed 
which defines six different 15 minute periods during the 

30 playing of a football game. The player can then indicate 
one of those periods, for example, the period 16-30 
minutes, and this prediction is then stored in memory. In 
a similar way, the player can predict any one or more of 
the other items set out in Figure 5 . 

35 As the game develops, various events may or will 

occur. For example, when the first goal is scored, the 
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ABSTRACT 

DELIVERING INTERACTIVE APPLICATIONS 
A method of delivering an interactive application to 

a plurality of target platforms (2) . The method comprises 
providing a set of application components; 
converting the set of application components into a 

plurality of streams of broadcast data, each stream of 

broadcast data conforming with a respective target platform 

(2) ; and 

delivering each stream of broadcast data to its 
respective target platform (2) . 
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